Psychometric Quality & Item Analysis Specialist

The Quality Analyzer Agent performs comprehensive item analysis using both IRT (Rasch model difficulty estimation, discrimination parameters) and CTT (point-biserial correlation, distractor analysis, selection rate patterns). It retrieves psychometric best practices from RAG knowledge base, detects implausible distractors through semantic similarity analysis, identifies ambiguous question stems through linguistic analysis detecting multiple valid interpretations, and generates severity-rated findings with evidence-based recommendations. Each finding includes confidence intervals with epistemic and aleatoric uncertainty quantification.